That is a neat idea.

Nice idea, I still find it always hard to find how to pass that option when opening a series in python and this comment doesn't help much. So maybe add an example like series = io.Series(path, io.Access.read_only, options='{"defer_iteration_parsing": true}') to the readthedocs documentation and link the paragraph in the warning? I think most users don't actually know how to use the json configuration.

Nice idea, I still find it always hard to find how to pass that option when opening a series in python and this comment doesn't help much. So maybe add an example like series = io.Series(path, io.Access.read_only, options='{"defer_iteration_parsing": true}') to the readthedocs documentation and link the paragraph in the warning? I think most users don't actually know how to use the json configuration.

I guess that the easiest way would be to write the example directly into the error message?

Nice idea, I still find it always hard to find how to pass that option when opening a series in python and this comment doesn't help much. So maybe add an example like series = io.Series(path, io.Access.read_only, options='{"defer_iteration_parsing": true}') to the readthedocs documentation and link the paragraph in the warning? I think most users don't actually know how to use the json configuration.

I guess that the easiest way would be to write the example directly into the error message?

Sure!

Now with a more extensive warning:

[openPMD] WARNING: Parsing Iterations is taking a long time.
Consider using deferred Iteration parsing in order to open the Series lazily.
This can be achieved by either setting an environment variable:

> export OPENPMD_DEFER_ITERATION_PARSING=1

Or by specifying it as part of a JSON/TOML configuration:

> // C++:
> Series simData("my_data_%T.%E", R"({"defer_iteration_parsing": true})");
> // Python:
> simData = opmd.Series("my_data_%T.%E", {"defer_iteration_parsing": True})

Iterations will then be parsed only upon explicit user request:

> series.snapshots()[100].open()  // new API
> series.iterations[100].open()   // old API

Alternatively, Iterations will be opened implicitly when iterating in
READ_LINEAR access mode.
Refer also to the documentation at https://openpmd-api.readthedocs.io

This warning can be suppressed also by either specifying
an environment variable:

> export OPENPMD_HINT_LAZY_PARSING_TIMEOUT=0

Or by the JSON/TOML option {"hint_lazy_parsing_timeout": 0}.

Elapsed time: 1s, parsed 592 of 10000 Iterations.
Elapsed time: 2s, parsed 1171 of 10000 Iterations.
Elapsed time: 3s, parsed 1734 of 10000 Iterations.
Elapsed time: 4s, parsed 2281 of 10000 Iterations.
Elapsed time: 5s, parsed 2816 of 10000 Iterations.